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Abstract 

The main aim of this study was to gather teachers’ views to determine the effect size of gender differences on 
the instructional leadership behavior of school principals. The standardized mean difference (SMD) was calcu¬ 
lated to measure the effect size in this study. An initial search yielded 126 studies on the research topic, which 
consists of master theses, doctoral theses, and conference proceedings. After a detailed inclusion process, 38 
studies, having data according to coding protocol, were included in the meta-analysis. The total study sample 
was 15,280 teachers of which 7,236 were males and 8,044 were females. The calculated effect size (SMD) for 
the random effect model was d = 0.048 [0.001 - 0.094], which indicated with statistical significance that male 
teachers were favored more. 
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The 20th century has found an increased focus 
on leadership by both theorists and practitioners 
(Er^etin, 2000, p. 3). Modern leadership researchers 
have claimed that leadership is one of the most 
frequently observed but least comprehended aspects 
(Evers & Lakomski, 1996, p. 77). In general terms, 
leadership can be described as a social process 
which affects peoples aims, individual motives, 
and abilities, their interpretation of internal and 
external activities, interpersonal communication 
and a groups common direction (Hoy & Miskel, 
2010, p. 377). In developed countries, in the latter 
part of the 20 th century, there has been a renewed 
research focus on educational leadership, with one 
of the most frequently studied leadership styles 


being instructional leadership. Research after the 
1980s has highlighted the crucial role that the 
leadership of a school principal has in developing 
schools and the education system (§i§man, 2004, p. 
49). Many independent variables were used in these 
research studies, but the primary focus tended to 
be examinations of the effect of teacher gender. 
However, there have not been consistent results 
in the research in terms of gender differences on 
the instructional leadership of principals ($i§man, 
2004, p. 31). Research indicates that instructional 
leadership differs from other leadership styles in 
that it is for educational settings only and is therefore 
complex and is affected by many situational factors 
and conditions (Hallinger & Murphy, 1985, p. 
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91). In the research between 1980-1995, Hallinger 
and Heck found a significant finding for the 
relationship between principal leadership and 
student academic success (cited in Zepeda, 2004, p. 
12). This finding was also strongly supported by a 
meta-analysis result with a d = 0.25 effect size for 
these variables. The greater the leadership, the more 
students gain success. This positive and statistically 
significant result highlighted the importance of 
good leadership in schools (Waters, Marzano, & 
McNulty, 2003). 

There are several definitions for instructional 
leadership in the literature. §i§man identified this 
type of leadership as a kind of power and behavior 
used to affect school society and conditions 
(§i§man, 2004, p. 58). It was the application of 
knowledge to problem solving and making use of 
others to realize the goals of the school (Krug, 1992, 
p. 152). In an earlier paper, identified educational 
leadership as the behavior that either the principal 
exhibits or uses to make others exhibit to increase 
student success at school (De Bevoise, 1984, p. 5. 
It is said that it was helping school communities 
adopt new habits (Glickman, Gordon, & Ross- 
Gordon, 2007, p. 96). 

Both qualitative and quantitative organizational 
research has been conducted in Turkey and in the 
world. In Turkey, there have been comprehensive 
studies conducted into decision making strategies 
and problem solving abilities (Arm, 2006; G. Kaya, 
2008), organizational citizenship (Qelik, 2010), 
teachers’ self-efficacy (Derbedek, 2008), teacher 
motivation (Ergen, 2009), job satisfaction (Gezici, 
2007), modes of communication (Giirsun, 2007), 
situational leadership styles (Sonmez, 2010), 
organizational climate (Tahaoglu, 2007), effective 
schools (Yilmaz, 2010), teacher organizational 
commitment (Yiice, 2010), teacher burnout (Arslan, 
2007), teacher career development (inceler, 2005), 
and emotional intelligence (Tikir, 2005). 

However, these studies have often had inconsistent 
results in terms of the various independent variables 
such as gender, title, education level, school size, 
and age. Some studies have found statistically 
significant results, whereas others did not find any 
significance at all (Akdag, 2009; Aksoy, 2006; Argon 
& Mercan, 2009; Arm, 2006; M. Arslan, 2009; Qelik, 
2010; Demiral, 2007; Derbedek, 2008; Donmez, 
2008; Ergen, 2009; Gokyer, 2004; Gulbahar, 2010; 
Giirsun, 2007; inandi & Ozkan, 2006; Inceler, 2005; 
Karatay, 2011; G. Kaya, 2008; O. Kaya, 2008; Onder, 
2010; Sagir, 2011; Sonmez, 2010; Soziieroglu, 2006; 
Tahaoglu, 2007; Yilmaz, 2010; Yiice, 2010). 


All in all, the findings of these studies could contribute 
significantly to the understanding of instructional 
leadership if a meta-analysis of the findings realized 
a statistically significant synthesis result. Further, 
giving a complete picture of the research situation 
could be invaluable for both future researchers 
and practitioners, and inform the direction of new 
research. However, no meta-analysis of the research 
results has yet been conducted. 

The aim of this study is to determine the effect size 
(standardized mean difference) of the teachers’ 
gender on the level of the instructional leadership 
of principals in Turkey. 

Method 

Research Design 

A meta-analysis research synthesis method was 
used in this study, which can be defined as a 
method of collecting studies from different places 
and different times on the same research topic, 
thereby increasing statistical power and sample size 
(Cumming, 2012, p. 6; Ellis, 2012, p. 5; Petticrew & 
Roberts, 2006, p. 194). 

Data Collection 

The data in the study came from Turkish master 
theses, doctoral theses, articles and conference 
proceedings. 

Keywords in Database Search: The following 
keywords were used to determine related studies: 
“instruction/al leader/ship,” “education/al leader/ 
ship,” “curriculum leader/ship,” “learning-centered 
leader/ship,” “pedagogic/al leader/ship,” “educative 
leadership.” 

Databases and Sources: The following databases 
were searched to locate the related studies: Higher 
Education Council theses database (YOK), TO- 
KAT, Google Scholar, ULAKBIM, and the Inonu 
University library central search, which is a member 
of many important academic databases. From this 
data search, 38 eligible studies were found for this 
meta-analysis. 

Inclusion Criteria: 

1- Time interval: 1993-2013 

2- Published and/or unpublished studies: master 
and doctoral theses, online or print articles and 
conference proceedings. 

3- Suitable method; empirical studies only, with 
identified gender groups. 


^ 2140 



Kl§. KONAN / A Meta-analysis of Gender Differences in terms of Teacher Views on the Instructional... 









Table 1 







Fixed Effect Model Results 

Studies Effect Size (d) 

Standard Error 

Variance 

Lower Level 

Upper Level 

Z Value 

p 

Fixed Effect Model 0,042 

0,017 

0,000 

0,010 

0,075 

2,555 

0,011 


4- Enough numerical data to calculate an effect 
size; mean, standard deviation, sample size, F, t , 
X 2 , and p values. 

Coding Protocol: For all included studies, there 
was a detailed coding protocol (Card, 2012, p. 
7; Cooper, Hedges, & Valentine, 2009, p. 127; 
Cumming, 2012, p. 6; Ellis, 2012, p. 98; Petticrew & 
Roberts, 2006, p. 194). 

Coding Reliability: Reliability of the coding 
protocol was also calculated (Card, 2012, p. 132; 
Petitti, 2000, p. 69). Inter-rater reliability (IRR) was 
calculated using both frequency data and Cohens 
Kappa formula. The agreement rate was found to be 
90.4% and 0.83, respectively. This result indicated a 
near perfect agreement between the raters (Cohen, 
1960; Landis & Koch, 1977; Viera & Garrett, 2005). 

Moderators: Moderators could be anything that 
affected the mean effect size both in magnitude and 
direction (Card, 2012, p. 64). 

Data Analysis 

The group difference meta-analysis method was 
used to calculate the effect size. Different scales 
were used to determine the level of the principals’ 
instructional leadership behavior, so a standardized 
mean difference (SMD), known as “Cohens d,” 
was chosen to measure the effect size (ES)in this 
research(Borenstein, Hedges, Higgins, & Rothstein, 
2009, p. 25; Card, 2012, p. 85). The statistical 
softwares “Comprehensive Meta-Analysis” (CMA) 
Ver. 2.0 and SPSS 17.0 were used to calculate the 
effect sizes and inter-rater reliability. The alpha level 
was chosen at .05. 

Findings 

Publication Bias 

Publication bias could possibly inflate the mean 
effect size, so this was tested before the effect sizes 
of the included studies were combined (Borenstein 
et al., 2009, p. 277). Two methods were used to 
test the possible publication bias: (a) a funnel plot, 
and ( b) Orwin’s Fail-Safe N. The first method has 
been accepted as a visual meta-analysis evaluation 
(Cooper et al., 2009, p. 437). Because nearly all 
studies were around the upper part and were 


symmetrically distributed on both sides of the 
mean effect size, no publication bias was evident. 

To further test the publication bias, Orwin’s Fail- 
Safe N was also calculated and it was found that 
124 more studies were needed to decrease the mean 
effect size level to d = 0.01, which indicated no 
difference level. This means that the requirement 
was 3.2 times more than the total studies included 
in this research. However, results indicated that 
there was no publication bias for this meta-analysis 
and the combination of the effect sizes was valid. 

Combined Effect Sizes 

First, all calculation were made for the fixed effect 
model. Table 1 shows the test results for this 
method. The mean effect size was found to be d = 
0.042 [0.010; 0.075]. 

This positive result indicates that male teachers’ 
perception of their principals’ instructional 
behaviors was greater than the females. However 
the level of this effect size was negligible according 
to the three benchmarks mentioned in the literature 
(Cohen, 1988; Thalheimer & Cook, 2002). 

Heterogeneity, Q and I 2 Statistics 

Six out of the 38 included studies (Balci, 2009; 
Bilgin, 2008; Giirsun, 2007; Kiip, 2011; Onder, 
2010; Yiice, 2010) were found to have a result 
near the mean effect size, whereas the remaining 
studies were either above or below the mean effect 
size. It was considered that the study distribution 
may show some heterogeneity, so to test this 
heterogeneity, Q and I 2 statistics were used. In Table 
2, the results show a moderate level of heterogeneity 
( P= 45.12%) (Cooper et al., 2009, p. 263). 


Table 2 


The Results of Heterogeneity Test 


Q value df (Q) p 

Lvalue 

67,427 37 0,002 

45,125 
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Table 3 







Random Effect Model Results 







Studies Effect Size (d) 

Standard Error 

Variance 

Lower Level 

Upper Level 

Z Value 

P 

Random Effect Model 0,048 

0,024 

0,001 

0,001 

0,094 

2,015 

0,044 


Random Effect Model Results 

For moderate level heterogeneity, the model was 
converted into a random effect model. The results 
are shown in Table 3. 

The mean effect size for the random effect model 
was 0.048 [0.001; 0.094]. These two models gave 
near similar results, indicating that the mean 
effect size result (SMD) was valid. For this model 
also, the level of the mean effect size was negligible 
according to the three benchmarks in the literature. 

Moderator Analysis Results 

The possible moderators in this meta-analysis were 
research area, publication type, sample content, 
school level, and scale preparative (that is, the 
author either developed the scale or used a ready¬ 
made one). However, as a result of the moderator 
analysis, none were found to be a moderator to 
explain further heterogeneity. 

Discussion and Conclusion 

A sample of 15,280 teachers was considered large 
enough to determine a synthesis value. In this 
meta-analysis, 191 effect sizes were calculated from 


the 38 studies. Having found no publication bias 
using visual and statistical methods, the mean effect 
size was calculated. For the fixed effect model it was 
0.042 [0.010; 0.075] in favor of male teachers. The 
heterogeneity tests (Q and I 2 statistics) revealed a 
moderate (45%) level of heterogeneity, so random 
effect model calculations were conducted. A similar 
result (0.048 [0.001-0.094]) was found. However, 
for both results, the meaning of two values was in 
fact negligible (Cohen, 1988; Cooper et al., 2009; 
Thalheimer & Cook, 2002). 

All in all, the calculated mean effect size indicated 
that there was a statistical difference between male 
and female teachers perception towards principals’ 
instructional leadership behavior. Yet, this effect 
was very small in practice, so can be ignored. For 
future research, as an independent variable, gender 
may not be needed. Moderator analysis also showed 
that so far there has not been any moderator which 
can explain the moderate level of heterogeneity. 

Unfortunately, there have not been any previous 
meta-analysis studies on this topic. Therefore, this 
result is not comparable. In the future, as more 
empirical studies are conducted on this topic, the 
meta-analysis could be repeated. 
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